Message transmission system, message transmission method, and program for wearable terminal

ABSTRACT

When a person  500  is present within a field of view of a user, a user terminal  10  acquires the field of view of the user as image data, and transmits the field-of-view image to a field-of-view image analysis server  100.  The field-of-view image analysis server  100  extracts a feature amount from the field-of-view image, and identifies the person near a center of the field-of-view image by referring to a feature amount database  150.  Further, the field-of-view image analysis server  100  reads information of the person from a person information database  151,  and sends the information to the user terminal  10.  The user terminal  10  transmits the inputted electronic message or image data via the message transmission server  200  based on the received person information such that the user can communicate with the person within the field of view by a message.

CROSS-REFERENCE TO RELATED APPLICATION

The present application claims priority to and the benefit of U.S.Provisional Application No. 62/135,771, filed on Mar. 20, 2015 in theU.S. Patent and Trademark Office, the entire contents of which areincorporated herein by reference.

BACKGROUND

(a) Field

The present invention generally relates to a message transmissionsystem, a message transmission method, and a program for a user tocommunicate with a person existing in a field of view.

(b) Description of the Related Art

Today, an electronic message such as an e-mail or an instant messaginghas become popular as means for communication between users. Theelectronic message composed of text data or image data is capable ofperforming accurate input and browsing in cluttered places compared witha conventional voice exchange and is particularly excellent in use incities with moving

However, the electronic message is typically used for communication withthe other party at remote, and it is common to perform conversations bynormal utterance upon directly facing with each other. In this case,since a speaker states while watching the other party of theconversation, it can be inferred that the statement has been made for aperson close to a center of a field of view of the speaker.

For example, Japanese Patent Application Publication No. 2000-350192describes an archive apparatus for appropriately handling informationretrieval from a database by determining a person who is in front of aspeaker's eyes at a meeting, converting audio data into text data, andstoring the text data together with person data.

However, in the archive apparatus described in Patent Document 1, theactual voice is merely stored together with the person who is in frontof the line of sight of the speaker serving the statement, and aproviding function is limited as the simple archive apparatus.

SUMMARY

An embodiment of the present invention is focused on a fact thatinformation can be accurately and quickly transferred, by transmittingan electronic message or an image of a field of view of the user to aperson that exists in the field of view of the user, with taking aformat that is similar to a direct dialogue, without an intervention ofa voice, and even in a cluttered place such as a city or a party venue.

An embodiment of the present invention provides a message transmissionsystem, a message transmission method, and a program for performing acommunication with the person that exists in the field of view of theuser, by acquiring the field of view of the user as image data,identifying the person present in the field of view, and transmitting anelectronic message or the image data.

According to an embodiment of the present invention, pa messagetransmission system for performing a communication with a person thatexists in a field of view of a user is provided. The messagetransmission system includes a field-of-view image acquisition apparatusincluding a field-of-view image acquiring module configured to acquire afield of view of the user as an image; a feature amount extractingmodule configured to analyze a field-of-view image acquired by thefield-of-view image acquiring module and to extract a feature amountassociated with an identification of a person; an person identifyingmodule configured to identify a person within the field-of-view imagefrom the feature amount extracted by the feature amount extractingmodule; and a message transmitting module configured to transmit anelectronic message to the person identified by the person identifyingmodule.

According to the above embodiment, in a message transmission system forperforming a communication with a person that exists in a field of viewof a user, a field-of-view image acquisition apparatus can acquire afield of view of the user as an image; and the message transmissionsystem can analyze the acquired field-of-view image, extract a featureamount associated with an identification of a person, identify a personwithin the field-of-view image from the extracted feature amount, andtransmit an electronic message to the identified person.

According to another embodiment of the present invention, the messagetransmission system further includes a field-of-view image transmittingmodule configured to transmit a part or whole of the field-of-view imageacquired by the field-of-view image acquiring module to the personidentified by the person identifying module.

According to the above embodiment, the message transmission system cantransmit a part or whole of the acquired field-of-view image to theidentified person.

According to yet another embodiment, the message transmission systemfurther includes a person image position calculating module configuredto calculate a position of the person identified by the personidentifying module within the field-of-view image and a personinformation displaying module configured to display information on theidentified person within the field of view of the user based on theposition calculated by the person image position calculating module.

According to the above embodiment, the message transmission system cancalculate a position of the identified person within the field-of-viewimage and displays information on the identified person within the fieldof view of the user based on the calculated position.

The above embodiments of the present invention relate to a messagetransmission system but may be applicable to a message transmissionmethod and a message transmission system program in the same manner.

According to still another embodiment of the present invention, amessage transmission method executed by a message transmission systemfor performing a communication with a person that exists in a field ofview of a user is provided. The message transmission method includesacquiring a field of view of the user as an image by a field-of-viewimage acquisition apparatus; analyzing the acquired field-of-view imageand extracting a feature amount associated with an identification of aperson; identifying a person within the field-of-view image from theextracted feature amount; and transmitting an electronic message to theidentified person.

According to further embodiment of the present invention, a messagetransmission system program for executing a message transmission methodon a message transmission system for performing a communication with aperson that exists in a field of view of a user is provided The messagetransmission method includes acquiring a field of view of the user as animage; analyzing the acquired field-of-view image and extracting afeature amount associated with an identification of a person;identifying a person within the field-of-view image from the extractedfeature amount; and transmitting an electronic message to the identifiedperson.

According to an embodiment of the present invention, a messagetransmission system, a message transmission method, and a program forperforming a communication with the person that exists in the field ofview of the user, by acquiring the field of view of the user as imagedata, identifying the person present in the field of view andtransmitting an electronic message or the image data can be provided.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram for explaining an outline of a messagetransmission system 1 according to an embodiment of the presentinvention.

FIG. 2 shows a system configuration of a message transmission system 1according to an embodiment of the present invention.

FIG. 3 shows a functional block diagram of a user terminal 10, afield-of-view image analysis server 100, and a message transmissionserver 200 according to an embodiment of the present invention.

FIG. 4 is a flowchart showing a procedure of an identifying process of aperson in a field-of-view image executed by a user terminal 10, afield-of-view image analysis server 100, and a message transmissionserver 200 according to an embodiment of the present invention.

FIG. 5 is a flowchart showing a procedure of a message transmissionprocess executed by a user terminal 10 and a field-of-view imageanalysis server 100 according to an embodiment of the present invention.

FIG. 6 shows a schematic diagram for explaining an overview of a userterminal 10 imitating glasses according to an embodiment of the presentinvention.

FIG. 7 shows an example of personal information displayed on a userterminal 10 by a personal information displaying module 19 according toan embodiment of the present invention.

FIG. 8 shows an example of personal information displayed in a case thata smart phone terminal is used as a user terminal 10 according to anembodiment of the present invention.

FIG. 9 is a diagram showing an example of a feature amount table in afeature amount database 150 according to an embodiment of the presentinvention.

FIG. 10 is a diagram showing an example of a personal information tablein a person information database 151 according to an embodiment of thepresent invention.

DETAILED DESCRIPTION

In the following detailed description, only certain embodiments of thepresent invention have been shown and described, simply by way ofillustration. As those skilled in the art would realize, the describedembodiments may be modified in various different ways, all withoutdeparting from the spirit or scope of the present invention.Accordingly, the drawings and description are to be regarded asillustrative in nature and not restrictive. Like reference numeralsdesignate like elements throughout the specification.

An overview of embodiments of the present invention is described. When aperson 500 is present within a field of view of a user, a user terminal10 acquires the field of view of the user as image data, and transmitsthe field-of-view image to a field-of-view image analysis server 100.The field-of-view image analysis server 100 extracts a feature amountfrom the field-of-view image, and identifies the person near a center ofthe field-of-view image by referring to a feature amount database 150.Further, the field-of-view image analysis server 100 reads informationof the person from a person information database 151, and sends theinformation to the user terminal 10. The user terminal 10 transmits theinputted electronic message or image data via the message transmissionserver 200 based on the received person information such that the usercan communicate with the person within the field of view by a message.

Overview of Message Transmission System

An overview of a message transmission system 1 according to anembodiment of the present invention is described with reference toFIG. 1. A message transmission system 1 according to an embodiment ofthe present invention includes a user terminal 10, a field-of-view imageanalysis server 100, and a message transmission server 200.

First, the user terminal 10 acquires a field-of-view image of the user.When the user sends a message to a person 500, the user terminal 10acquires the field-of-view image including the person 500 as shown inFIG. 1 (Step S01).

Next, the user terminal 10 transmits the acquired field-of-view image tothe field-of-view image analysis server 100 (Step S02). Thefield-of-view image analysis server 100 analyzes the receivedfield-of-view image and extracts a feature amount for determining aface, a system, or the like.

Information about a feature amount for identifying a person is stored,in advance, in a feature amount database 150 in a storage unit that isprovided with the field-of-view image analysis server 100. Thefield-of-view image analysis server 100 identifies the person in thefield-of-view image based on the extracted feature amount by referringto the feature amount database 150 (Step S03). The field-of-view imageanalysis server 100 queries information about the identified person to aperson information database 151 in the storage unit (Step S04) and readsthe personal information (Step S05). Then, the field-of-view imageanalysis server 100 sends the read person information to the userterminal 10 (Step S06).

The user terminal 10 transmits to the message transmission server 200the identified person information and a message content to be sent tothe identified person (Step S07). Here, the user terminal 10 may includethe field-of-view image acquired on the current and past in the messagecontent. The message content to be sent may be inputted by catching theperson 500 in the field of view by using an input device such as akeyboard, or may be completely inputted prior to the step S01. That is,the person 500 may be included within the field-of-view image at thetime of step S01 and the input of the message may be completed at astage where the step S05 is executed.

Also, when transmitting a message via the message transmission server200, a transmitting scheme is not limited to a regular e-mail protocoland an instant message (IM) may be used. In addition, a scheme forcalling a message function provided with a specific software or a socialnetworking service (SNS) by an API or the like may be used. The messagemay be electronically transmitted and received, and may include at leastcharacter information. The user terminal 10 transmits to the messagetransmission server 200 the message content and the identified personinformation serving as a destination in a format that is based on aspecific message transmission standard, and the message transmissionserver 200 transmits the content to the identified person as a message(Step S08).

The person 500 receives, at a message receiving device 501, the messagetransmitted by the message transmission server 200. The messagereceiving device 501 may receive the message transmitted by the messagetransmission server 200. The message receiving device 501 is not limitedto an information terminal such as a smart phone, a personal computer,or the like and may be a terminal with the same type as the userterminal 10.

The above is the overview of the message transmission system 1 accordingto a preferred embodiment of the present invention.

System Configuration of the Message Transmission System 1

FIG. 2 shows a system configuration of a message transmission system 1according to an embodiment of the present invention. A messagetransmission system 1 according to an embodiment of the presentinvention includes a public line network 3 such as an internet network,a user terminal 10, a field-of-view image analysis server 100, and amessage transmission server 200. The user terminal 10 is communicablyconnected to the field-of-view image analysis server 100 and the messagetransmission server 200 via the public network 3.

Here, the field-of-view image analysis server 100 and the messagetransmission server 200 may be a physically same server. In a case thatall of functions of the field-of-view image analysis server 100 and themessage transmission server 200 are provided with the user terminal 10,the message transmission system 1 may be formed by only the userterminal 10.

Description of Each Function

A configuration of each device is described with reference to FIG. 3.The user terminal 10 according to an embodiment of the present inventionincludes, as a controller 11, a central processing unit (CPU), a randomaccess memory (RAM), a read only memory (ROM) or the like, and includes,as a communication unit 12, for example a WiFi (wireless fidelity)enabled device conforming to the IEEE standard 802.11. Further, the userterminal 10 includes, as an input-output unit 13, a photographing devicesuch as a camera or the like for acquiring a field of view of a user asan image and further includes a display unit such as a liquid crystaldisplay or a projection screen for displaying an image or a text messageand an input unit such as a keyboard or a touch panel for receiving aninput from the user.

In the user terminal 10, the controller 11 reads a predeterminedprogram, thereby realizing a field-of-view image transmitting module 14,a personal information receiving module 15, and a message contenttransmitting module 16, in cooperating with the communication unit 12.Further, in the user terminal 10, the controller 11 reads apredetermined program, thereby realizing a field-of-view imagephotographing module 17, a field-of-view image adjusting module 18, apersonal information displaying module 19, a destination determiningmodule 20, and a message content input receiving module 21, incooperating with the input-output unit 13.

Like the user terminal 10, the field-of-view image analysis server 100according to an embodiment of the present invention includes, as acontroller 101, a CPU, a RAM, a ROM, and the like, and includes, as acommunication unit 102, for example a WiFi enabled device conforming tothe IEEE standard 802.11 or a device for performing a data communicationwith a radio access point and other electrical appliance such as adevice capable of achieving a connection by a wired cable. The fieldimage analysis server 100 includes, as a storage unit 103 for storingdata and files, a data storage unit formed by a hard disk, asemiconductor memory, a recording medium, a memory card, or the like.The storage unit 103 further includes a feature amount database 150 anda person information database 151.

In the field-of-view image analysis server 100, the controller 101 readsa predetermined program, thereby a field-of-view image receiving module104 and a personal information transmitting module 105, in cooperatingwith the communication unit 102. In the field-of-view image analysisserver 100, the controller 101 reads a predetermined program, therebyrealizing a feature amount extracting module 106, a personidentification module 107, and a personal information reading module108, in cooperating with the storage unit 103

Similarly to the field-of-view image analysis server 100, the messagetransmission server 200 according to an embodiment of the presentinvention includes, as a controller 201, a CPU, a RAM, a ROM, and thelike, and includes, as a communication unit 202, for example a WiFienabled device conforming to the IEEE standard 802.11 or a device forperforming a data communication with a radio access point and otherelectrical appliance such as a device capable of achieving a connectionby a wired cable.

In the message transmission server 200, the controller 201 reads apredetermined program, thereby realizing a transmission messagereceiving module 203 and a message transmitting module 204, incooperating with the communication unit 202.

Process of Identifying Person in Field-of-View Image

FIG. 4 is a flowchart showing a procedure of an identifying process of aperson in a field-of-view image executed by a user terminal 10 and afield-of-view image analysis server 100 in a message transmission system1 according to an embodiment of the present invention. The identifyingprocess of the person in the field-of-view image is described.

First, a user terminal 10 acquires a field-of-view image of a user. Afield-of-view image photographing module 17 photographs a field-of-viewimage of the user (Step S11). FIG. 6 shows a schematic diagram forexplaining an overview of a user terminal 10 imitating glasses accordingto an embodiment of the present invention. A camera 51 is presentapproximately in the center of the user terminal 10 and photographs afield-of-view image of the user by taking a photograph toward the frontof the user.

In one embodiment, under a circumstance that is similar to ancircumstance where the user is always directed to right in front, animage of a front direction taken by the camera 51 may be directly usedas the field-of-view image of the user. However, in another embodiment,when the user is actually facing at two or more persons at the sametime, may occur a circumstance for acquiring a center of thefield-of-view image of the user more accurately in consideration of acase where the user moves his or her eyeball while fixing the face. Afield-of-view image adjusting module 18 of the user terminal 10 mayacquire a line of sight of the user and adjust a center or a range ofthe field-of-view image (Step S12). For example, a scheme described inJapanese Patent Application Publication No. 2010-204823 may be used byinstalling an Infrared light source 52 and an infrared camera 53 on aback of a frame, photographing an eyeball image of the user, andcalculating the line of sight of the user.

In some embodiments, a lens 54 of the user terminal 10 may be formed bya reflection process that is special to a face of the user side suchthat an image projected by a small projector 55 can be displayed on thefield of view by overlapping. The user terminal 10 may include akeyboard 56 and a touch panel as an input unit.

Next, a field-of-view image transmitting module 14 of the user terminal10 transmits the adjusted field-of-view image to the field-of-view imageanalysis server 100 (Step S13). A field-of-view image receiving module104 of the field-of-view image analysis server 100 receives thefield-of-view image (Step S14).

A feature amount extracting module 106 of the field-of-view imageanalysis server 100 extracts a feature amount of the image in order toidentify a person included near the center of the received field-of-viewimage (Step S15). In some embodiments, the feature amount may be a valueserving as evaluation criterion when performing pattern recognition thatrecognizes as a pattern the person's face or body previously stored fromthe received field-of-view image. More specifically, the feature amountextracting module 106 may identify an area corresponding to the humanface or body from the vicinity of the center of the receivedfield-of-view image, equally divide the identified area into verticallya predetermined number and horizontally a predetermined number, andcalculate an average value of colors of pixels in each portion. Then,the feature amount extracting module 106 may regard as the featureamount an average value of colors which greatly varies depending on aposition or size of a facial contour, a nose, an eye, an eyebrow, or thelike.

In some embodiments, a person identification module 107 of thefield-of-view image analysis server 100 may compare the extractedfeature amount with a feature amount of each of persons stored inadvance in the feature amount database 150 to calculate its difference.Further, the person identification module 107 may determine a personwhose probability is highest from among the persons by multiplying eachdifference by a weighting coefficient which is set for each featureamount and normalizing the multiplied results together, and identify theperson with the highest probability as the person that is near thecenter of the field-of-view image (Step S16).

FIG. 9 is a diagram showing an example of a feature amount table in afeature amount database 150 according to an embodiment of the presentinvention. Here, it is assumed for simplicity that the number of personis two and the field-of-view image has 256 colors, and five featureamounts from feature amount 1 to feature amount 5 are represented by anumber between 0 and 255. However, it is common to improve the accuracyby representing the more feature amounts by the wider range.

Thereafter, a person information read module 108 of the field-of-viewimage analysis server 100 reads information of the identified personfrom a person information database 151. A person informationtransmitting module 105 transmits the person information to the userterminal 10 (Step S17). In some embodiments, the person informationtransmitting module 105 may simultaneously transmit a position withinthe image of the portion that the feature amount extracting module 106identifies as a portion corresponding to the face or body.

FIG. 10 is a diagram showing an example of a personal information tablein a person information database 151 according to an embodiment of thepresent invention. The person information table stores personalinformation including a person name, a gender, and an age of eachperson, and destinations of messages.

A personal information receiving module 15 of the user terminal 10receives the personal information (Step S18). A personal informationdisplaying module 19 of the user terminal 10 may display the receivedperson information in the vicinity of the portion corresponding to theface or body of the person by using the position information within theimage received at the same time.

FIG. 7 shows an example of personal information displayed on a userterminal 10 by a personal information displaying module 19 according toan embodiment of the present invention. FIG. 7 shows a case that theuser terminal 10 is viewed from a user side. A person 61 is not adisplaying content but is a part of a field of view penetrated through alens 65. Personal information 62 of the person 61, a pointing rod 63,and a description text 64 are displayed with being overlapped with theperson 61. These displaying contents may be projected onto the lens 65by a compact projector installed in a string of the glasses.

In some embodiments, a smart phone terminal or the like having a displaydevice such as a liquid crystal display or an organic light emittingdisplay and a camera may be used as the user terminal 10 instead of theglass-type terminal shown in FIG. 7. FIG. 8 shows an example of personalinformation displayed in a case that a smart phone terminal is used as auser terminal 10. If the user sets up a smart phone terminal 10 b infront of eyes, an image photographed by a camera of the smartphoneterminal 10 b is viewed on the field of view of the user and isdisplayed on a touch panel 75 of a display device such as a liquidcrystal panel. That is, the user can see an appearance of a person 71through the touch panel 75 without directly looking at the person 71with naked eyes. Similarly to FIG. 7, person information 72, a pointingrod 73, and a description text 74 are displayed. In addition, if asoftware keyboard 76 by the touch panel is used, it is possible to viewthe software keyboard 76 while fixing the camera serving a viewpoint.Accordingly, the input can be easily performed as compared to theglasses-type terminal. The user can transmit a message content that iscreated to the person 71 by tapping the description text 74. Whenattaching the field-of-view image to the message, the current or pastfield-of-view image can be attached by tapping a field-of-view imageattachment button 78.

The above is the identifying process of the person in the field-of-viewimage that is executed by the user terminal 10 and the field-of-viewimage analysis server 100 in the message transmission system 1.

Message Transmission Process

FIG. 5 is a flowchart showing a procedure of a message transmissionprocess executed by a user terminal 10 and a message transmission server200 in a message transmission system 1 according to an embodiment of thepresent invention. The message transmission process is described.

First, a destination determining module 20 of the user terminal 10receives an input from a user and determines a destination of a message(Step S21). The destination of the message may be selected from adestination included in person information acquired an identifyingprocess of a person in a field-of-view image described above ordestination to which a message is sent in the past.

Next, a message content transmitting module 16 of the user terminal 10determines whether a message content to be transmitted is inputted. Ifthe input of the message content is not completed (Step S22: NO), amessage content input receiving module 21 receives an input of themessage content from the user (Step S23). When the message content hasbeen already inputted to message content input receiving module 21before the destination of the message is selected (Step S22: YES), theprocess continues without performing the step S23.

Thereafter, the message content transmitting module 16 transmits themessage content and the destination of the message to a messagetransmission server 200 (step S24). A transmission message receivingmodule 203 of the message transmission server 200 receives the messagecontent and the destination of the message (step S25).

A message transmitting module 204 of the message transmission serverperforms a transmission process of the message based on the receivedmessage content and destination of the message (step S26). Further, thetransmission process may be for example, a process for processing a mailtransmission request if the message is a mail or a process for writingthe message content into a message box area of a user corresponding tothe destination if the message is a message function in an SNS.

The above is the procedure of the message transmission process that isexecuted by the user terminal 10 and the message transmission server 200in the message transmission system 1.

The above-described means and functions may be realized by reading andexecuting a predetermined program by a computer (including a CPU, aninformation processing apparatus, and various terminals). The programmay be recorded in a computer-readable recording medium, for example, aflexible disk, a CD (e.g., a CD-ROM or the like) and a DVD (e.g., aDVD-ROM, a DVD-RAM, or the like). In this case, the program may be readfrom the recording medium by the computer and be transmitted to aninternal storage unit or an external storage unit to be stored andexecuted. Further, the program may be pre-stored in a storage unit(recording medium) such as a magnetic disk, an optical disk, or anoptical magnetic disk and be transmitted from the recording medium tothe computer through a communications line.

While embodiments of the present invention have been described, thepresent invention is not limited to these embodiments described above.Further, the advantageous effects described in embodiments of thepresent invention are merely a list of the most preferable effectsresulting from the present invention and the advantageous effects of thepresent invention are not limited to those described in embodiments ofthe present invention.

DESCRIPTION OF REFERENCE NUMBERS

1: Message transmission system, 10: User terminal, 100: Field-of-viewimage analysis server, 150: Feature amount database, 151: Personalinformation database, 200: Message transmission server

What is claimed is:
 1. A message transmission system for performing acommunication with a person that exists in a field of view of a user,the message transmission system comprising: a field-of-view imageacquisition apparatus including at least a field-of-view image acquiringmeans configured to acquire a field of view of the user as an image; afeature amount extracting means configured to analyze a field-of-viewimage acquired by the field-of-view image acquiring means and to extracta feature amount associated with an identification of a person; anperson identifying means configured to identify a person within thefield-of-view image from the feature amount extracted by the featureamount extracting means; and a message transmitting means configured totransmit an electronic message to the person identified by the personidentifying means.
 2. The message transmission system of claim 1,further comprising a field-of-view image transmitting means configuredto transmit a part or whole of the field-of-view image acquired by thefield-of-view image acquiring means to the person identified by theperson identifying means.
 3. The message transmission system of claim 1,further comprising: a person image position calculating means configuredto calculate a position of the person identified by the personidentifying means within the field-of-view image; and a personinformation displaying means configured to display information on theidentified person within the field of view of the user based on theposition calculated by the person image position calculating means.
 4. Amessage transmission method executed by a message transmission systemfor performing a communication with a person that exists in a field ofview of a user, the message transmission method comprising: acquiring afield of view of the user as an image by a field-of-view imageacquisition apparatus; analyzing the acquired field-of-view image andextracting a feature amount associated with an identification of aperson; identifying a person within the field-of-view image from theextracted feature amount; and transmitting an electronic message to theidentified person.
 5. The message transmission method of claim 4,further comprising transmitting a part or whole of the acquiredfield-of-view image to the identified person.
 6. The messagetransmission method of claim 4, further comprising: calculating aposition of the identified person within the field-of-view image; anddisplaying information on the identified person within the field of viewof the user based on the calculated position.
 7. A message transmissionsystem program for executing a message transmission method on a messagetransmission system for performing a communication with a person thatexists in a field of view of a user, the message transmission methodcomprising: acquiring a field of view of the user as an image; analyzingthe acquired field-of-view image and extracting a feature amountassociated with an identification of a person; identifying a personwithin the field-of-view image from the extracted feature amount; andtransmitting an electronic message to the identified person.
 8. Themessage transmission system program of claim 7, wherein the messagetransmission method further comprises transmitting a part or whole ofthe acquired field-of-view image to the identified person.
 9. Themessage transmission system program of claim 7, wherein the messagetransmission method further comprises: calculating a position of theidentified person within the field-of-view image; and displayinginformation on the identified person within the field of view of theuser based on the calculated position.